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Abstract 

It  is  shown  how  to  compute  the  detection  probability  of  certain  .signals 
by  numerical  integration  of  the  Laplace  inversion  integral  involving  the 
characteristic  function  or  the  moment-generating  function  of  the  detection 
statistic.  The  contour  of  integration  is  taken  as  the  path  of  steepest  descent 
of  the  integrand  and  is  determined  numerically  as  the  integration  proceeds. 

The  method  is  applied  to  calculating  the  performance  of  the  optimum  detector 
of  a  Caussian  stochastic  signal  in  white  noise  when  the  signals  actually  pre¬ 
sent  have  a  different  average  s.n.r.  from  that  assumed  in  the  design.  Results 
are  presented  for  narrowband  signals  with  Lorentz  and  rectangular  spectral  den- 
sities.  The  detectability  of  the  former  is  shown  to  he  more  sensitive  than 
that  of  the  latter  to  the  value  of  the  design  s.n.r.  The  relative  disadvantage 
of  the  threshold  detector,  also  assessed  by  this  method,  is  smaller  for  signals 
with  a  rectangular  than  for  those  with  a  Lorentz  spectral  density. 
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I.  Inlroduct i on 


In  calculating  the  probability  of  detecting  a  certain  kind  of  signal  by 
means  of  a  certain  receiver,  it  sometimes  happens  that  although  the  character¬ 
istic  function  of  the  detection  statistic  is  known  in  rather  simple  form,  in¬ 
verting  it  to  determine  the  probability  density  function  of  the  statistic  and 
integrating  that  to  find  the  detection  probability  may  be  quite  difficult. 

One  example  is  the  detection  of  a  fading  radar  signal  by  a  receiver  that,  sums, 
or  "integrates",  the  quadratically  i-ectified  outputs  of  a  matched  filter  follow¬ 
ing  transmission  of  a  number  of  radar  pulses.  When  the  fading  is  described  as 
in  Swerling's  Cases  111  and  IV,  for  instance,  the  average  detection  probability 
can  be  written  down  in  closed  form,  but  it  is  very  complicated,  although  the 
characteristic  function  from  which  it  is  derived  is  relatively  simple  [1]. 
Straightforward  computation  with  that  closed  form  is  a  lengthy  process  when  the 
number  of  pulses  integrated  is  large,  and  it  may  require  double  precision  in 
order  to  avoid  overflow  or  underflow  of  the  numbers  involved. 

Another  example  is  the  detection  of  a  narrowband  stochastic  .signal,  as 

in  radar  astronomy  and  scatter-multipath  communications  [2].  When  the  signal. 

* 

can  be  modeled  as  a  segment  of  a  Gaussian  stochastic  process  and  is  received  in 
white,  noise,  the  characteristic  function  of  the  optimum  detection  statistic  can 
be  expressed  as  an  infinite  product  involving  the  eigenvalues  of  the  autoco¬ 
variance.  function  of  the  signal  process,  and  the  probability  of  detection  comes 
out  as  an  infinite  series  when  this  characteristic,  function  is  inverted  by  means 
of  the  residue  theorem  [3,4,5].  Computations  with  this  series  are  feasible  only 
when  the  number  of  significant  eigenvalues  is  small,  unless  both  the  eigenvalues 
and  the  terms  of  the  series  are  carried  to  double  precision. 

Problems  such  as  these  generally  involve,  a  detection  statistic  that  can 

* 

at  least  roughly  be  represented  as  the  sum  of  a  certain  number  of  independent .-e 
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random  variables;  this  number  can  be  termed  the  number  of  ’’degrees  of  freedom" 
in  the  statistic.  In  radar  detection  it  is  the  number  of  pulses  integrated; 
in  detecting  a  stochastic  signal  it  is  the  product  of  the  bandwidth  of  the  sig¬ 
nal  and  the  observation  time.  The  inversion  of  the  characteristic  function  by 
the  residue  theorem  in  order  to  determine  the  probability  density  function  of 
the  statistic,  and  its  integration  to  obtain  the  probability  of  detection,  be¬ 
come  computationally  the  more  difficult,  the  larger  the  number  of  degrees  of 
freedom  in  the  detection  statistic. 

The  probability  of  detection  can  also  be  expressed  as  a  contour  integral 
involving  the  characteristic  function  or  the  moment-generating  function  (m.g.f.) 
of  the  detection  statistic.  Here  we  shall  describe  how  the  detection  probabil¬ 
ity  can  be  conveniently  calculated  by  numerical  evaluation  of  this  integral 
along  an  appropriate  path.  The  path  goes  through  the  same  sadllepoint  of  the 
integrand  that  was  featured  in  an  approximate  method  for  evaluating  such  inte¬ 
grals,  described  in  [6].  By  choosing  the  contour  of  integration  as  that  along 
which  the  integrand  decreases  to  zero  most  rapidly  on  each  side  of  the  saddle- 
point,  the  integral  can  be  expeditiously  and  accurately  evaluated  by  applying 
the  trapezoidal  rule  [7].  This  contour  of  integration  is,  known  as  the  path  of 
steepest  descent. 

An  advantage  of  the  method  is  that  it  can  be  applied  when  the  number  of 
degrees  of  freedom  is  arbitrarily  large.  The  principles  underlying  it  are.  lu¬ 
cidly  explained  in  the  book  by  Carrier  _et^  _al.  [8].  It  was  used  in  a  fluid- 
mechanical  problem  by  Esch  [9],  and  a  particular  method  for  locating  the  path 
of  steepest  descent  and  numerically  integrating  aiong  it  was  described  by  Rice 
[7].  A  somewhat  different  method  for  determining  the  path  will  be  presented  in 
Section  III.  Because  the  use  of  steepest-descent  integration  to  calculate  de¬ 
tection  probabilities  seems  not  to  be  widely  known  among  radar  engineers  and 
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system  analysts,  it  will  be  reviewed  here  in  terms  of  a  particular  example, 
that  of  calculating  the  detectability  of  Gaussian  stochastic  signals  in  white 
noise. 

The  optimum  detector  of  Gaussian  stochastic  signals  requires  for  its  de¬ 
sign  either  knowledge  of  or  an  assumption  about  the  average  signal-to-noise 
ratio  of  the  signals  to  be  detected.  The  performance  of  this  optimum  detector 
was  extensively  analyzed  by  Van  Trees  [5]  by  means  of  an  approximation  to  the 
error  probability  akin  to  the  Chernoff  bound,  but  he  assumed  that  the  average 
s.n.r.  of  the  signals  actually  arriving  was  equal  to  that  for  which  the  detec¬ 
tor  was  designed.  The  performance  of  this  detector  when  the  average  input 
s.n.r.  differs  from  that  assumed  in  the  design  seems  not  to  have  been  studied. 
Here  we  shall  show  how  that  can  be  done  by  utilizing  a  new  factorization  of 
the  m.g.f.,  which  is  presented  in  Section  II,  and  which  permits  efficient  cal- 
culation  of  the  detection  probability'  by  the  residue  series  for  low  values  of 
tlie  time-bandwidth  product.  Section  III  shows  how  to  calculate  the  detection 
probability  for  arbitrarily  large  values  of  that  product  by  steepest-de. scent 
integration.  Section  IV  describes  how  to  calculate  the  decision  level  required 
for  attaining  a  pre-assigned  false-alarm  probability'.  The  results  are  presented 
in  Section  V  as  graphs  of  the  average  input  s.n.r.  needed  in  order  to  attain  a 
given  pair  of  false-alarm  and  detection  probabilities,  as  a  function  of  the 
average  s.n.r.  for  which  the  detector  has  been  designed  to  be  optimum.  The  re¬ 
sults  enable  us  in  particular  to  assess  the  loss  in  signal  detectability  entail¬ 
ed  by  adopting  the  threshold  detector,  which  is  optimum  in  the  limit  of  vanish¬ 
ing  input  s.n.r.  and  is  simpler  to  construct  than  the  detector  that  is  optimum 

for  finite  input  s.n.r.  The  calculations  were  carried  out  for  signals  with  two 

_2 

types  of  spectral  density,  the  Lorentz,  which  decreases  to  zero  like  |w|  at 
large  frequency  deviation  |w|  from  the  carrier  frequency,  and  the  rectangular, 


which  is  confined  to  a  finite  spectral  band,  within  which  it  is  uniform.  These 
two  types  of  spectral  density  represent  opposite  extremes,  bracketing  spectral 
densities  with  a  variety  of  asymptotic  dependence  on  J to J .  It  is  found  that  the. 
detectability  of  signals  with  the  Lorentz  spectral  density  is  much  more  sensi¬ 
tive  to  the  choice  of  the  design  s.n.r.  than  is  the  detectability  of  signals 
with  a  rectangular  spectral  density. 
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II.  The  Detectability  of  Gaussian  Stochastic  Signals. 


(a)  The  Optimum  Detector 

A  narrowband  Gaussian  stochastic  signal 

s(t)  =  Re  [S(t)eint] 

of  carrier  frequency  ft  is  to  be  detected  in  the  presence  of  white  Gaussian  noise 
of  unilateral  spectral  density  N  by  observation  of  the  input 

v ( t)  =  Re  [V(t)cl0t] 

to  a  receiver  during  an  interval  (0,T).  The  complex  autocovariance  function 
of  the  signal  is 

4><t1 » t2)  =  i-E[S(t1)S*(t2)J,  (1) 

E  standing  for  expected  value,  and 

E[S(t1)S(t2)]  =  0. 

• 

The  derivation  of  the  optimum  and  threshold  detectors  is  well  enough  known  that 
a  summary  to  establish  notation  will  suffice  [3,4,5]. 

Define  hypothesis  11^,  as  the  proposition  that  the  complex  envelope  of  the 
input  v(t)  to  the  receiver  is 

V(t)  =  Y*S(t)  +N(t),  (2) 

where  N(t)  is  the  complex  envelope  of  the  white  noise,  with 

|E[N(t1)N*(t2)]  =  N6(t1-t2), 

E[N(t1)N(t2)]  =  0.  (3) 

The  parameter  Y  measures  the  strength  of  the  incoming  signals  relative  to  that 
of  the  signals  for  which  the  receiver  is  designed  to  be.  optimum. 

The  complex  envelope  V(t)  of  the  input  is  sampled  by  means  of  a  set  of 
functions  f^(t)  orthonormal  over  the  observation  interval  (P,T), 
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v(t)  =2^i  2kf  k(t) ,  2k  =  /  fk*(t  )v(tjdt . 

k=l 


(4) 


By  taking  the  f  (t)  as  the  eigenfunctions  of  the  kernel  N  $(t ,  t  )  , 

ri  1  2. 


Vk(t)  =  N 

the  complex  samples  z^  =  xk + 
Gaussian  random  variables  who 


1l  <j>(t,s)fk(s)ds, 

•  n 


iyk  are  statistically 
s.e  real  and  imaginary 


■Vk, 


(b) 


independent. ,  circular-complo 
parts  have  variances 


*E(Vk*IV  =  Nd+yy 


(6) 


under  hypothesis  H  ;  the  joint  p.d.f.  of  a  finite  number  n  of  them  can  he 
written 


yl . yn>  “  V  V 

....  y 

n 

i  1 2 

J~[  [2ttN(1  yy]-1  exp 

k=l 

‘  k' 

2N(l+yXk) 

(7) 


The  optimum  detection  statistic  U  is  proportional  to  the  logarithm  of  the 
likelihood  ratio  P^/Pq  in  the  limit  n  -*■ 


OO 


E 
1^  =  1 


2  1 


"<1+Vj 


OO 


(8) 


This  statistic  is  compared  with  a  decision  level  U^;  when  U  >  U^,  the  receiver 
decides  that  a  signal  is  present.  The  value  of  is  set  so  that  the  false- 
alarm  probability  Pr  (U  >  Uq|Hq)  takes  on  a  pro-assigned  value  Q^. 

We  shall  calculate  the  probability 


(K(Y)  =  Pr  (U  >  Ujll  ) 


(9) 


that  the  receiver  decides  a  signal  present  when  the  one  actually  on  hand  is  a 
realization  of  a  narrowband  Gaussian  stochastic  process  with  complex  autocovar¬ 
iance  ^ie  moraent-SeTlcratiuS  function  (m. g.  f . )  of  the  statistic  U 


under  hypothesis  H  is 


hy (s)  =  E(e  SU|H^) 


[2hN(1  +  yX 


lzk!  sXklzkl 

exp  -  2N(1  +  YTk)"  ~  2NU  + dXkdyk 


(l  +  Pk(Y)s]  1> 


where 


V1+YV . 

l'k(Y)  "  — mr — 

k 


Then  the  detection  probability  is 


Qd(Y)  = 


/c+i<» 

s'V! 

-f  m 


s)  exp  (U0s)ds/2tTj  , 


-VJ1  1  <  c  <  0, 


by  the  inversion  theorem  for  Laplace  transforms;  the  contour  of  integration 

runs  parallel  to  and  to  the  left  of  the  imaginary  axis  in  the  complex  s-plane, 

but  to  the  right  of  the  singularities  of  the  m.g.f.  hy(s).  By  evaluating  the 

contour  integral  by  the  residue  theorem,  we  find 

00 

Qd(y)  -  2  pke*p  [-i'0/Mk(Y)], 


f!  (•  -  5? 
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A  form  often  more  convenient  for  computation  arises  by  factoring  the  tern 


of  h^(s)  as 


1+ v  ■ 


n  CL  +  sUj.+ysXj/  (l  +  asik)U  +  es»k) 


where 


ag  =  a(s;y)  =  §{l  +  s  +  [(1  +  s)2  -  4ysfs}, 


3S  =  3(s;y)  =  iil  +  8-  [ (1  +  s)2  r  4ys] *}; 


and  the  m.g.f.  is 


,  ,  x  = _ DO)  _ 

V  '  D(as)D(P>s) 


in  terms  of  the  Fredholm  determinant 


D(s)  =  7  ,  (1  +  X  s> 


associated  with  the  integral  equation  (5) . 

At  the  pole  sR  =  -[^(y)]  of  h  (s)  , 

y(l  +  Xk) 

a  =  a(s.  ,y)  =■  a,  =  -nr— — r— > 
s  k’ '  k  1  +yAk 


Bs  =  B(sk,y)  =  -  1/Ak. 


Thus  the  poles  of  h  (s)  reside  in  the  factor  [D(3  )]  of  (16),  and  the  residue 

y  s 


at  s  =  equals 


(1  +  2yXfc  +  yXR  )D(1) 


D(ak)D’(-Xk  1)(d0s/ds)s=s  (l  +  yXk)2D(ak)D,(-Xk"1) 

k 


the  prime  indicating  the  derivative  dD(s)/ds.  Again  evaluating  (12)  by  the 


residue  theorem,  we  find  for  the  detection  probability 


8 


Z-1 


■’k<I)<1  +  2'\  +  t\2) 


Od(Y)  -  .-(I)  ^  a  +  vxk)(1+,k)„(„k, 


exp 


VT) 


(20) 


where  the  coefficients 


pk(1)  =  VD'("V 


11 -n  ('-«"■ 


(21) 


independent  of  y,  can  be  computed  once  for  all  values  of  the  design  s.n.r. 

(b)  Tlie  Threshold  Detector 

The  threshold  detection  statistic  U0  is  obtained  by  neglecting  X  in  the 
denominator  of  each  term  in  (8),  as  though  the  signal  for  which  the  detector 
is  designed  to  be.  optimum  were  much  weaker  than  the  noise, 


U0  =  (2K) 


Z  \.u 


k=l 

e 


k'"k'  . 


(22) 


It  is  compared  with  a  decision  level  Uq  ,  and  a  signal  is  declared  present  when 


0 


U0  >  U0  .  The  m.g.f.  of  the  threshold  statistic  is 

h^e(s)  =  E[exp(-sU0)  | Iiy ] 


n 

k=l 


[1  +  y  0(y)s]  1 

Iv 


=  tD(«g)D(6^) ]  \ 


\  (Y)  =  Ak(1+YV’ 


ag  =  2  [s  +(s  ”  4ys):;J>  Ps  =  j  ls‘(s  “  4ys)c] , 


(23) 

(24) 

(25) 


A  similar  analysis  shows  that  the  detection  probability  attained  by  the 
threshold  detector, 


Qd6(Y)  =  Pr  (UQ  >  U0°|Hy), 


(26) 


is  given  by  the  residue  series  (13)  with  p  replaced  by  p  ,  or  by 
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(27) 
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(The  origin  of  the  w-scale  is  the  carrier  frequency  ft.)  The  1 inear  systems, 
described  by  state  vectors  of  finite  dimension,  are  then  stationary,  as  are 
the  white-noise  generators.  By  utilizing  a  linear  system  with  complex  state 
variables,  as  shown  by  Van  Trees  [5,  Appendix,  pp.  565-598],  a  broader  class 
of  complex  signal  envelopes  S(t)  could  be  handled,  but  this  has  not  been  neces¬ 
sary  in  the  work  reported  here.  Once  one.  has  the  Fredholm  determinant,  the 
eigenvalues  A^  can  be  calculated  by  finding  its  zeros  Sj_, 

DCs^)  =0,  A^  =  -l/s^,  k  =  1,  2,  ... 

When  the  real  and  imaginary  parts  of  the  signal  envelope  S(t)  are  inde¬ 
pendent  Gauss-Markov  processes,  the  complex  autocovari  mice  function  is 


4>(t,s)  =  $0  e 


-Vi  t-s 


the  signal  has  a  Lorentz  spectral  density 


21^0 

$(«)  -  ~2 - j  > 

W  +  \r 


(30) 


(31) 


and  as  shown  by  Siegert  [10]  the  Fredholm  determinant  is 


D(s)  =  u+z)2en*-a_^&r?±. 


4ge 


m 


g  =  (1  +  ks)  E,  m  =  pT,  K  =  ,  (32) 

where  E  =  4>qT  is  the  average  energy  of  the  signals  s(t).  The  eigenvalues  A^ 
are  given  by 


A 


k 


.  2 
K  sxn 


(33) 


where 


is  a  root  of  the  transcendental  equation 


m  cot  9^  =  20^  +  (k  -  l)ir, 

k  =  1,  2,  . . . ,  0  <  0k  <  tr/2. 


(34) 


which  can  quickly  be  solved  by  Newton's  method.  The  associated  value  of  g  in 


For  k  »  1  the  eigenvalues  are  approximately 


Km 


k  “  2  ,  ,,22 

m  +  ( k  -  1)  "it 

(1) 


«■*  *('Vvj 


(35) 


In  terms  of  0,  the  constants  p  defined  by  (2.1)  are 

K.  K. 

(i>  _  <-»  g  5111 2°k 


(36) 


m  +  2  sin  0, 


For  a  stationary  .leucogenic  signal  whose  narrowband  spectral  density  $(w) 
has  the  form  of  that  for  tlie  noise  in  an  RLC  circuit  in  thermal  equilibrium, 
the  Fredholm  determinant  has  been  calculated  by  Slepian  [12], 

(d)  Computation  with  the  Residue  Series 

When  the  eigenvalues  Afc  drop  off  rapidly  to  zero  with  increasing  index  k, 
it  is  unnecessary  to  have  the  Fredholm  determinant  D(s)  in  closed  form  in  order 
accurately  to  evaluate  the  residue  series  (13),  (20),  and  (27),  provided  one 
has  computed  a  sufficient  number  of  those  eigenvalues.  The  behavior  of  the 
eigenvalues  illustrated  by  (35), 

A^  rs  N  ^(km/T),  k  »  1, 


is  at  least  approximately  manifested  for  arbitrary’  smooth  spectral  densities 
$(to) ,  and  the  more  rapidly  the  spectral  density  decreases  to  zero  with  increas¬ 
ing  angular  frequency'  to,  the  more  expeditious  computation  witli  the  residue 
series  becomes. 

2 

When  the  narrowband  spectral  density  <H<o)  is  a  rational  function  of  to  , 
the  eigenvalues  A^  can  be  calculated  by  methods  given  by  Youla  [13],  the  writer 
[14],  Slepian  and  Kadota  [15],  and  Baggeroor  [11].  The  method  of  [11]  applies 
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•?;T 

1  (j>(t  -  u)  J  ^dtdu  (42) 

T 

in  terms  of  the  complex  autocovarianco  function  <Ji(x)  -  <J)(t,t+x)  for  a  sta¬ 
tionary  signal,  and  it  is  approximately  equal  to  the  time-bandwidth  product  WT 
when  large. 

When  the  time-bandwidth  product  is  large,  computation  with  the  residue 
series  (13),  (20),  and  (27)  becomes  infeasible.  Its  terns  alternate  in  sign, 
and  as  the  terms  of  lowest  order  are  of  the  same  order  of  magnitude,  they  must 
be  evaluated  with  high  precision  if  the  series  is  to  be  accurately  summed.  The 
constants  p  in  (13)  and  p^^  in  (20)  and  (27)  involve  differences  of  the  eigen¬ 
values,  and  because  the  eigenvalues  of  lowest  order  lie  close  together,  these 
must  be  known  to  many  significant  figures  in  order  to  determine  those  constants 
accurately.  The  situation  is  least  favorable  for  the.  rectangular  spectral  den¬ 
sity,  for  which  the  eigenvalues ' are  tabulated  to  only  eight  significant  figures, 
and  computing  them  to  more  significant  figures  would  be  laborious.  Even  for  the 
Lorentz  spectral  density,  the  residue  series  has  been  found  to  be  inaccurate  for 

WT  of  the  order  of  10  or  larger.  Another  method  of  evaluating  the  detection 

* 

probability  Q(j(T)  must  be  sought. 


111.  Steepest  Descent  Integral  ton 

When  summing  the  residue  series  is  not  feasible,  we  resort  instead  to  eval¬ 
uating  the  integral  in  (12)  or  its  counterpart 


l-Qd(Y)  =  Q 


.  c  i  i°  ' 

j(Y)  =  I  s  1hY(s)  exp  (U0s)ds/2rj 

*'c-io:’  .  „ 


numerically.  Wc  have  a  broad  latitude  in  picking  the  location  and  the  form  of 
the  contour  of  integration,  and  we  try  to  choose  them  in  the  most  advantageous 
manner.  Viewed  a s  a  function  of  s  for  real  values  of  s  in  -}i^  ^  <  Re  s  <  "> 


the  int  egrand 


exp  Y(s)  -  (  +  s)  h  (s)  exp  (UyS) 


of  (12)  or  (A3)  has  two  minima,  one  at  a  point  s  =  Uy'  in  -j:,  <  Re  s  <  0,  the 

'other  at  a  point  s  ~  Uy"  >  0.  (For  we  use  -s  when  the  path  of  integrat  ion 
passes  through  Uy'  and  (12)  is  evaluated,  and  we  use  H-s  when  the  path  passes 
through  u0"  and  (A3)  is  evaluated.)  As  a  function  of  complex  values  of  s,  the 
integrand  has  saddlepoints  at  Uy*  and  Uy"  [6].  If  the  path  of  Integration  passes 
vertically  through  Uy'  or  Uy",  the  magnitude  of  the  integrand,  vthic.h  is  maximum 
at  the  saddlepoint,  decreases  most  rapidly  as  the  point  s  =  u  +  jv  moves  up  or 
down  the  contour  from  Uy'  or  Uy". 

These  saddlepoints  are  the  roots  of  the  equation 

r(U0)  =-d-  [£n  h  (8)]  +  Uy-Uy"1  =  0, 

S=Uy 

uo  =  uo’’uo"’  (45) 

primes  on  H7  denoting  differentiation,  and  this  equation  can  be  expeditiously 
solved  by  Newton's  method. 
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y"<u0)  «  72  '£"Vs),-„+U0  >0 


It  will  be  necessary  to  compute  these  derivatives  numerically  if  the  Fredholm 
determinant  P(s)  involved  in  h^(s)  is  not  knovvii  in  closed  form  or  is  too  com- 
pli  cated.  Alternatively  one  can  use  Newton's  method  to  solve  the  equation 

Im  Y(u  +  jv)  =  0  (47) 

for  u,  with  the  imaginary  part  v  taken  infinitesimal,  but  positive,  evaluating 
the  derivative  of  this  function  numerically.  The  values  of  u  '  and  u^"  need 
not  he  known  to  high  precision. 

In  [6]  the  integrals  in  (12)  and  (43)  were  evaluated  approximately  as 


Qd(Y)  ss  [  27rf,,(u0 ' )  ]~c  exp  V  (Uq  ' ) 


when  U0  >  E(u|n  ),  u'Q  <  0,  and 


l-Qd(Y)-  [2^'"(u0")]"sexpH'(u0"),  (49) 

when  UQ  <  E(ll|ll  ),  u0"  >  0.  That  paper  [0]  lists  previous  work  on  "saddlcpo int 
approximations"  of  this  kind. 

The  path  along  which  the  integrand  in  (12)  and  (43)  decreases  most  rapidly 
to  zero  is  called  the  path  of  steepest  descent  [8],  Along  the  path  of  steepest 
descent  the  integrand  remains  real,  or  what  is  the  same  thing, 

ImH'(s)  =  arg  h^(s)  +  UQs  -  arg(±s)  =  0,  s  =  u  +  jv,  (50) 

where  arg  s  is  the  principal  value  of  Im  (£n  s) .  Because  the  integrand  de¬ 
creases  most  rapidly  along  this  path,  a  numerical  integration  of  (12)  or  (43) 
along  it,  utilizing,  let  us  say,  the  trapezoidal  rule,  requires  fewest  steps 
in  order  to  attain  a  prescribed  accuracy.  Solving  (50)  precisely  at  each  point 
along  the  path  at  which  the  integrand  is  evaluated,  however,  would  much  protract 


L6 
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As  with  the  saddlepoint  approximat i on  in  (48),  (49),  the  integration  starts 
from  u  *  <  0  for  U„  >  E(u|H  )  and  from  u >  0  for  b'  <  L(u|ll  ).  When  the  de- 

0  0  1  >  0  0  '  y 

cision  level  1!^  is  close  to  the  mean  E(u|h  ),  it  does  not  rat! cr  at  which  saddle- 
point  the  integration  begins.  The  summation  is  stopped  when  the  magnitude 
exp [Re  f(sm) 1  °f  the  integrand  falls  below  a  specified  fraction  of  the  value 
of  the  sum  so  far  accumulated. 

If  (50)  were  solved  exactly,  the  factor  exp  'T(s  )  in  (52)  would  be  real  and 

m 

the  term  jAu  in  As  -  Av  -  jAu  would  not  contribute,  but  since  (50)  is  solved  only 
approximately  in  order  to  save  computer  time,  H'(s  )  has  a  small  imaginary  part, 
which  combined  with  jAu  induces  a  small,  but  necessary  correction  to  the  terms 


of  (52). 

The  initial  step-size  was  taken  as 

Av  =  |2y"(u0)|  a,  uQ  =  uQ’  or  u0",  (53) 

which  is  of  the  order  of  magnitude  of  the  width  of  the  integrand  as  a  function 
of  v  in  the  vertical  direction.  The  second  derivative  H'"(oq)  arises  in  solving 
(45)  to  determine  the  saddlepoint  and  is  thus  known  before  integration  begins. 

Figures  1  and  2  show  typical  paths  of  steepest  descent  for  calculating  the 

% 

probabilities  ~  0^(0)  and  Qj_(l)  =  l-Q^(l)  for  the  optimum  detectors  of  sto¬ 
chastic  signals  having  Lorentz  and  rectangular  spectra,  respectively.  The  neg¬ 
ative.  numbers  along  the  paths  indicate  log.^  t^ie  ratf°  °f  the  value  of  the 
integrand  at  each  marked  point  to  that  at  the  saddlepoint.  The  rapid  decrease 
in  the  integrand  is  evident. 

By  expanding  the  exponent  H'(s)  of  the  integrand  in  (12)  or  (43)  in  a  power 

4 

series  about  the  saddlepoint  and  keeping  terms  through  (s  -  u^)  ,  one  finds  for 
the  equation  of  the  path  of  steepest  descent  in  that  region 


•  til  O 

2  U(6H'0"+  3V0"'  o  +  S'0  U  ) 

V  “  uT~TmT  vt;  l ill, . 

0  0 


U  =  u  “  u0’ 
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Thus 


Trials  with  both  (52)  and  (56)  with  the  same  design  s.n.r.  Sq  ~  E/N  for 

values  of  the  time-bandwidth  product  WT  equal  to  4,  8,  12,  20,  and  35,  with 

-4 

the  decision  level  Uq  selected  to  yield  a  falsc-alarm  probability  of  10  and 
with  the  spacing  Av  selected  as  in  (53),  yielded  identical  results  to  eight 
significant  figures.  With  the  integration  stopped  when  the  magnitude  exp[Re  'F(s)] 
fell  to  10  ^  times  the  value  of  the  accumulated  sum,  eleven  steps  were  required. 
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Halving  the  step-size  changed  the  result  only  in  the  eighth  significant  figure, 
and  only  onc-e  by  wore  than  one  digit  in  that  place;  twenty  or  twenty-one.  steps 
were  required.  Tl>e  curvature  a  decreased  slightly  as  WT  increased  from  A  to  35 
Integration  for  Q^(0)  and  Q^O)  along  the  path  in  Fig.  2  for  the  rectangu¬ 
lar  spectral  density  and  along  the  approximating  parabola  (55)  yielded  results 
stable  to  seven  significant  figures  with  eight:  steps. 


IV.  Sot  tint’,  the  Decision  Level 


The  decision  level  t’  is  to  be  sot  at  such  a  value  that  a  pre-assigned 


false-alarm  probability 


Q0  -  Qa(0)  - 


A 


(U)dU 


is  attained;  p  (u)  is  the  probability  density  function  of  the  statistic  U  undo 
hypothesis  that  no  signal  is  present.  Starting  from  a  trial  value  of  Uq,  a 
new  trial  value  can  be  computed  by  Newton's  method, 

Q,(0)  -Q 

u0  *  °0  -  ,.,<v  •  <59> 

and  the  procedure  repeated  until  the  value  of  ceases  changing  significantly 
The  residue  series  for  the  terms  in  (55)  is  from  (20) 

^  ["  U. +  A.)U0 

Qd<0)  -  DO)  2.,  rirr  - r—  <6« 

K  _L  K.  K 


and  by  differentiation 


P0(UQ)  =  D(l) 


CO  (1) 

V  Pk 

Z_/  — -  exp 

k=l  Ak 


•<1  +  V°o 


When  the  time-bandwidth  product  WT  is  so  large  that  computation  with  the 
residue  series  is  infeasible,  the  probability  CO)  can  be  calculated  by  inte¬ 
grating  (12)  with  y  =  0  along  the  path  of  steepest  descent  or  along  a  parabola 
as  in  (56).  The  density  function  p^(U)  is  given  by  a  similar  contour  integral 


p0(«)  - 


/  h° 
•'/O 


(s)eUsds/2nj . 


Although  it  is  not  the  best  contour  for  evaluating  (62),  the  stcepest-doscent 


in  (53),  can  be  used  to  integrate  ((>2)  numerically  as  veil;  the  computer  accumu¬ 
lates  both  sums  s imultanecnif.ly .  The  value  of  p  (T  )  in  (59)  is  not  needed  to 
great  accuracy  in  order  for  Newton's  method  to  be  applied. 

Computer  time  can  be  saved  by  determining  the  initial  trial  value  of  U 
by  the  more  rapidly  calculated  saddle-point  approximation  in  (48) ,  which  for 
this  purpose  takes  the  form 


Q0  -  l2’V<V>  rE  'R-TnT^Ti) 


iT 


«Vo,) 


(63) 


with 


exp 


h'0(s)] 


___D(1) _ 

sl)(s  +  1) 


(U0s). 


(64) 


Solved  for  U^,  (63)  yields 

U0  =  u0,"1£n{|2i-’i'0"(u0,)!^|u0,|l)(u0' +1)Q0/D(1)}.  (65) 

One  puts  a  crude  trial  value  of  the  decision  level  Uq  into  (45),  determines  the 
saddlepoint  u^'  <  0,  calculates  a  new  trial  value  of  from  (65),  and  iterates 
this  procedure  until  it  converges;  it  has  been  found  to  do  so  rapidly.  The  re¬ 
sult  is  the  initial  trial  value  of  U  for  (59)’. 
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V.  Perfcr  ij.nnco  of  tin;  Opt  imum  and  Threshold  Detectors 

Equipped  nov  with  accurate  means  of  calculating  the  detection  probability 
Q^(y)  for  a  range  of  values  of  the  time— band wi tlth  product  WT,  we  can  compare 
the  perfo; mance  of  detectors  designed  to  be  optimum  for  various  values  of  the 
design  s.n.r.  Sy  =  E/N,  including  the  threshold  detector,  for  which  that  design 
s.n.r.  equals  zero.  We  set  the  f alse-alarm  probability  Qy  -  Q  (0)  equal  to  10 
and  determined  the  decision,  lex  els  Uy  as  described  in  Section  IV.  The  input 
s.n.r.  S  -  ySy  required  to  attain  detection  probabilities  Qy (y)  =  Qy  =  0.9, 

0.99,  0.999,  and  0.9999  were  then  computed  by  Newton's  method.  That  is,  with 
a  suitable  increment  Fy,  a  new  trial  value  of  the  ratio  y  was  deter... ined  by 

Y  ~  Y  -  qT^yT  -  V7i  iY 

in  which  the  values  of  Q^(y)  and  Qy(y  +  6y)  were  determined  by  either  the  residue 
series,  as  in  Section  II,  or  the.  contour  integral,  as  in  Section  Ill,  depending 
on  whether  the  time-bandwidth  product  WT  was  small  or  large. 

The  resulting  input  s.n.r.  S  =  yS^  are  plotted  in  db.  in  Fig;.  3-7  versus 
the  s.n.r.  Sy  for  which  the  receiver  is  designed  to  be  optimum.  Figures  3  and 
4  display  the  results  for  signals  with  Loren tz  and  rectangular  spectral  c’ens.i.tie 
respectively,  and  with  the  same  time-bandwidth  product  WT  =  8/tt  =  2.5465.  Fig¬ 
ures  5  and  6  do  the  same  for  WT  -  14/ii  =  4.4563.  (These  values  of  WT  correspond 
to  values  of  Slepian's  parameter  c  equal  to  4  and  7,  respectively.)  Figure  7 
displays  the  input  s.n.r.  for  signals  with  a  Lorent?.  spectral  density  and  WT  =  35 

Each  of  the  curves  in  these  figures  exhibits  a  minimum  at  that  value  of  the 
design  s.n.r.  Sy  for  which  Qy(l)  equals  the  fixed  detection  probability  Qy  for 
the  curve.  For  larger  design  s.n.r.  the  curves  rise  extremely  slowly;  in  this 
range  the  performance  is  quite  insensitive  to  the  s.n.r.  f otr  which  the  detector 
is  designed  to  be  optimum.  For  smaller  design  s.n.r.,  on  the  other  band,  the 


curves  rise  rapidly  to  their  peak  value  at  S  =  0,  which  1  epi  cs- nts  the  threshold 
detector.  The  difference  be  tween  that  peak  value  and  the  minimum  measures  the 
relative  performance  d i  sad  cant' ape  of  the  threshold  detector. 

This  relative  disadvantage  is  much  smaller  for  signals  with  a  rectangular 
spectral  density  than  for  signals  with  a  Lorentz  spectral  density,  for  equal 
values  of  the.  time-bandwidth  product:  WT.  The  reason  is  easily  seen.  because 
for  the  rectangular  spectral  density  the  integral  equation  (5)  has  approximately 
WT  equal  eigenvalues  X  ,  and  the.  rest  are  negl  igiblo,  the  opt  i  mints  detector  is 

K 

very  like  a  detector  that  employs  the  decision  statistic 

[WT] 

U'  -  2J  \\\Z 

k=l 

for  all.  values  of  the  design  s.n.r. ,  where  [WT]  in  the  integral  part  of  WT. 

•That  this  is  a  good  approximation  is  evident:  from  (£').  The  statistic  U'  has 


approximately  a  scaled  chi- squared  distribut  ion  v.i  tli 


degrees  of  freedom. 


The  performance  of  the  optimum  detector  for  signals  with  a  rectangular  spectral 
density,  therefore,  does  not  vary  much  over  the  entire  range  of  valt.  ;i  the 
design  s.n.r.  For  signals  with  a  Lorentz  spectral  density,  on  the  other  hand, 
the  relative  weighting  of  the  terms  in  (8)  is  far  from  uniform  and  depends 
more  strongly  on  the  design  s.n.r.  As  l’ig.  7  shows,  even  at  WT  -  35  the.  dif¬ 
ference  between  the  threshold  detector  and  the  detector  optimum  at  each  of  the 
prescribed  values  of  Q^(l)  is  of  the  order  of  0.65  db.  Although  the  thres¬ 
hold  detector  is  close  to  the  optimum  when  the  s.n.r.  per  degree  of  freedom, 
E/(NWT)>  is  small,  the  weak-signal  approximation  by  which  it  is  derived  becomes 
valid  for  signals  with  a  sharply  cut-off  spectral  density  at  lower  values  of 
the  time-bandwidth  product  WT  than  for  signals  whose  spectral  density  declines 
only  slowly  to  zero  with  increasing  frequency  deviation  |w|. 


It  was  the  efficiency  of  numerically  in  t  egraL  i  nr,  the  Laplace  inversion 


integrals  in  (12)  and  (43)  along  the  path  of  steepest  descent  or  i Is  osculato/y 
parabola  that  enabled  computing  in  a  re  as  on  a  1  !  u  time  the.  great  number  of  values 
of  the  detection  probability  Q  (y)  needed  for  napping  the  performance  of  tin  so 
detectors  to  the  extent  described  here.  The  method  is  worthy  of  trial  wherever 
cumulative  probabilities  are  to  be  evaluated  for  random  variables  whose  moment - 
generating  or  characteristic  functions  arc  known  in  analytic  or  computable  form 
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Figure  Captions 


Fig.  1.  Paths  of  steepest  descent  in  contour  integration  of  (12)  for  Qj(0), 
Q^(l)  :  LorenLx  spectral  density,  WT  =  8,  Sq  r  100,  ~  34.849121, 


Fig.  2.  Paths  of  steepest  do.-. cent  in  contour  in t eg  rat  ton  of  (12)  for  Q^(0), 
Q^(l):  rectangular  spectial  density,  WT  =  14/t,  =  4.4563,  ~  100, 

UQ  =  18.195885,  Q0  =  10“4. 

-4 

Fig.  3.  Input  s.n.r.  to  yield  detection  probability  for  =  10  ,  versus 

design  s.n.r.  S^:  Lorentz  spectral  density,  WT  =  8/n  -  2.5465.  Curves  are 
indexed  with  the  value  of  Q^. 

Fig.  4.  Input  s.n.r.  to  yield  detection  probability  for  =  10  4,  versus 

design  s.n.r.  S^:  rectangular  spectial  density,  WT  =  S/v  -  2.5465.  Curves 

are  indexed  with  the  value  of  Q,. 

d 

Fig.  5.  InpuL  s.n.r.  to  yield  detection  probability  for  -  10  versus 

design  s.n.r.  S^:  Lorentz  spectral  density,  WT  =  14/ti  =  4.4563.  Curves 
are  indexed  with  the  value  of  Q^. 

—  _4 

Fig.  6.  Input  s.n.r.  to  yield  detection  probability  for  =  10  ,  versus 

design  s.n.r.  Sq!  rectangular  spectral  density,  W1  =  14/ if  -  4.4563.  Curves 

are  indexed  with  the  value  of  Q,. 

d 

—  -4 

Fig.  7.  Input  s.n.r.  to  yield  detection  probability  for  =  10  ,  versus 

design  s.n.r.  S^:  Lorentz  spectral  density,  WT  =  35.  Curves  arc  indexed 
with  the  value  of  Q  . 
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